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IN' THE 'UNITED STATES PATENT AND TRADEMARK OFFICE 



In re Application of 



Atty. Docket 



GERARDUS P.M. EGELMEERS ET AL . 



NL 000172 



SERIAL NO. : 



GROUP ART UNIT: 



FILED: CONCURRENTLY 



EXAMINER: 



ACOUSTIC ECHO AND NOISE CANCELLATION 



Honorable Commissioner of Patents and Trademarks 
Washington, D.C. 20231 



Sir: 



PRELIMINARY AMENDMENT 
Prior to calculating the filing fee and examination, 
please amend the above-identified application as follows: 

IN THE SPECIFICATION 
Page 1, before line 1, insert as a centered heading 

—BACKGROUND OF THE INVENTION ; 
after the heading, insert at the left margin 
— Field Of The Invention — ; 
line 1, change "as described in the preamble of Clai 



to --comprising at least two inputs for receiving 
at least two signals, and an output for supplying 



an output signal. — ; 



line 2, 



indent to form a new paragraph; 
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lines 3 L 5, delete in their entirety, and insert as a new 
paragraph 

The invention further relates to a 
teleconferencing system, a voice-controlled 
electronic device, and a noise cancellation 
system. — ; 

line 6, indent to form a new paragraph; 

change "as described in the preamble of claim 
14." to —for filtering at least two signals and 
for supplying an output signal. — ; 

line 8, indent to form a new paragraph; 

line 10, change "in mini group" to — , in mini-group—; 

after "systems" insert — , — (comma); 
line 13 should be a continuation of line 12; 
line 13, change "voice controlled" to 

— voice-controlled — ; 
line 14, after "equipment" insert (comma); 

after "players" insert — ,— (comma); 
line 15, indent to form a new paragraph; 

change "in general" to — , in general,—; 
between lines 16 and 18, insert at the left margin 

--Description Of The Related Art—; 
line 18, delete in its entirety, and insert --U.S. Patent 

5,828,756 discloses — ; 
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line 19', delete "known of"; 

change "system such" to — system, such — ; 

line 21, after "Herein" insert — , — (comma); 

line 22, after "non-linearities" insert — , — (comma); 

line 24, after "applications" insert — , — (comma); 
after "music" insert — , — (comma); 

between lines 24 and 26, insert as a centered heading 
— SUMMARY OF THE INVENTION — ; 

line 28, delete in its entirety, and insert — described in 
the opening paragraph, characterized in that the 
coefficient updates are determined in a 
transformed domain, and the filter comprises 
means for reducing the effect of correlation 
between the input signals on the coefficient 
updates . — ; 

Page 2, line 1, indent to form a new paragraph; 

after "Herewith" insert — , — (comma); 
lines 3-14, delete in their entirety; 

between lines 14 and 17, insert as a centered heading 
— BRIEF DESCRIPTION OF THE DRAWINGS — ; 

line 18, after "advantage" insert — , — (comma); 

line 19, change "figures. Herein shows:" to — accompanying 
drawings, in which:--; 



S : \ GO \PV21 GOB 0 . GOR 



3 



lines 20, 22, 24 and 27, after "schematically" insert 
--shows--; 

lines 21, 23, 28, 30, 32 and 34, change "invention," to 

— invention; — ; 
line 26, change "estimation," to — estimation; — ; 
line 29, after "5" insert — shows — ; 
line 31, after "6" insert — shows — ; 
line 33, after "7" insert — shows — ; 

change "voice controlled" to 

— voice-controlled — ; 
Page 3, line 1, after "8" insert — shows — ; 

between lines 1 and 3, insert as a centered heading 

— DESCRIPTION OF THE PREFERRED EMBODIMENTS—; 
line 3, indent to form a new paragraph; 

after "description" insert — , — (comma) ; 

change "etc" to — etc., — ; 
lines 6, 8 and 9, change "like" to — e.g., — ; 
line 6, after "(e.g." insert — , — (comma); 
line 7, change "matrix the" to — matrix, the — ; 
line 8, change "matrix" to — matrices — ; 
line 10, before "the complex" insert — denotes — ; 

after "conjugate" insert — , — (comma); 
line 11, before "the" insert — denotes — ; 
line 13, change "figure" to — Figure — ; 
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lines 14-16, change "until" (all occurrences) to 
line 21, beford "the FIR" insert — , — (comma); 
line 27, change "for 5>a>0" to — , for S > a > 0 , 
Page 5, line 10, after "B" insert — , — (comma); 

before "we" insert — , (comma); 
change "figure" to — Figure — ; 
line 16, after "filter" insert — , — (comma); 
line 20, after "Filters" insert — , — (comma); 
Page 6, line 1, after "filters" insert — , — (comma); 

line 3, after "application" insert — , — (comma) 
line 4, change "crosscorrelation" to 

--cross-correlation — ; 
line 5, change "block processing" to --, block 

processing, — ; 
line 6, after "iteration" insert — (comma) ; 

after " S>a>0" insert --, — (comma); 
line 1, after "that" insert — , — (comma); 
Page 9, line 16, after "errors" insert — , — (comma) ; 

line 22, before "we can" insert — , — (comma) ; 
line 25, after "case" insert — , — (comma) ; 
line 27, change "however" to — , however,--; 
Page 10, line 10, change "in practice" to in practice, 

lines 14 and 22, change "in" to --on--; 
line 14, change "however" to — , however, — ; 
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line 15; after "signals" insert — , — (comma); 
line 24, after -"case" insert — , — (comma); 
Page 11, line 15, after "and" insert (comma); 

line 18, change "diagonal," to — diagonal; — ; 
Page 13, line 2, after "matrix" insert — , — (comma); 

line 4, after "lemma" insert — , — (comma); 
line 13, after "L" insert (comma); 
Page 14, line 6, before "there" insert — , — (comma) ; 

line 7, after "choose" insert — , — (comma); 
line 11, before "then" insert — , — (comma); 
line 15, after "equation" insert — , — (comma); 
line 16, change "table 1" to — Table 1, — ; 
Page 16, line 6, change "schematically" to — , schematically,--; 
line 12, after "example" insert — , — (comma); 
line 14, change "US-A-4 , 903, 247 . " to — U.S. Patent 

4, 903,247.—; 
line 15, after "Further" insert — , — (comma) ; 
line 17, change "WO-97-45995." to — International Patent 
Application WO-97-45995, corresponding to U.S. 
Patent Application Serial No. 08/862,021, filed 
May 22, 1997.--; 
line 19, change "figure 6 only one of those" to — Figure 

6, only one of these--; 
line 20, after "side" insert — , — (comma) ; 
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line 23; before "further" insert —is—; 
line 25, change, "voice controlled" to 

— voice-controlled — ; 
line 26, after "engine" insert — ,— (comma); 
line 28, change "also in this example" to — , also, 

this example, — ; 
line 33, after "example" insert (comma); 
change "which beam" to —which—; 
Page 17, line 1, delete "former"; 

line 2, after "Further" insert — ,— (comma); 
line 5, after "canceller" insert — , — (comma); 

change "in fact" to --, in fact,— ; 
line 7, change "figure" to —Figure—; 
line 9, change "beamformer" to — beam former—; 
line 10, change "behaviour" to —behavior—; 
line 12, change "noticed" to —noted—. 

IN THE ABSTRACT 
Please cancel the present Abstract, and substitute 
therefor the Abstract appearing on the following page: 
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ABSTRACT OF THE DISCLOSURE 

Stereo echo cancellation is necessary to overcome the 
objections observed by, for example, teleconferencing, voice- 
controlled video/audio apparatuses, etc. To improve the existing 
filters, an adaptive filter is used, along with a signal processing 
device which obtains coefficient updates in the transformed domain, 
reducing the required calculation complexity. Further, the filter 
includes circuitry for reducing the effects of correlation between 
the input signals on the coefficient updates. 
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IN THE CLAIMS 
Please amejid the claims as follows 
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1. (Amended) [-Adaptive] An adaptive filter comprising at least 
two inputs for receiving at least two signals , and an output for 
supplying an output signal, characterized in that the adaptive 
filter further comprises: 

means for determining coefficient updates [are determined] 
in a transformed domain^ and [that the filter comprises] 

means [to reduce] for reducing the effect of [the] 
correlation between the input signals on the coefficient updates. 

2. (Amended) [Adaptive] The adaptive filter [according to] as 
claimed in claim 1, characterized in that the transformed domain is 
the frequency domain. 

3. (Amended) [Adaptive] The adaptive filter [according to 
claim2] as claimed in claim 2 , characterized in that the filter 
comprises an update algorithm with transformed auto- and a cross 
correlation matrices. 

4. (Amended) [Adaptive] The adaptive filter [according to] as 
claimed in claim 2, characterized in that said reducing means 
achieves the reduction of the effect of the correlation [is 
achieved] by multiplying the frequency domain input signals with 
the inverse of the input channel's power matrix. 
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5. (Amended) [Adaptive] The adaptive filter [according to] as 
claimed in claim 4, characterized in that said adaptive filter 
comprises a first order recursive network for determining the input 
channel's power matrix [is determined by a first order recursive 
network] , [with] said first order recursive network receiving the 
product of the frequency domain input signals and their conjugates 
as input, and [further characterized] in that_^_ at each iteration^ a 
certain positive value is added to all elements of the main 
diagonal . 

6. (Amended) [Adaptive] The adaptive filter [according to] as 
claimed in claim 4, characterized in that the algorithm comprises 
[a] solving a linear set of equations with the input channel power 
matrix as one of the elements of the equations. 

7. (Amended) [Adaptive] The adaptive filter [according to] as 
claimed in claim 3, characterized in that the adaptive filter 
comprises means for directly estimating the inverse of the input 
channel's matrix [is estimated directly,] using a recursive update 
algorithm, and [further characterized] in that a limit is imposed 
on the eigenvalues of the matrix. 



S : \GO\PV21GOB0 . GOR 



11 



8. (Amended) 1 [Signal] A signal processing device comprising 
[a] an adaptive filter [-according to] as claimed in claim 1. 



9. (Amended) [Signal] The signal processing device [according 
to] as claimed in claim 8, characterized in that the device further 
comprises a dynamic echo and noise suppressor as a post-processing 
device coupled to an output of the adaptive filter. 

10. (Amended) [Signal] The signal processing device [according 
to] as claimed in claim 8, characterized in that the signal- 
processing device comprises a programmable filter, 

11. (Amended) [Teleconferencing] A teleconferencing system 
comprising at least one signal-processing device [according to] as 
claimed in claim 8 . 

12. (Amended) [Voice controlled] A voice-controlled electronic 
device comprising at least one signal-processing device [according 
to] as claimed in claim 8. 

13. (Amended) [Noise] A noise cancellation system comprising at 
least one signal-processing device [according to] as claimed in 
claim 8 . 
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14. (Amended) 1 [Method] A method for filtering at least two 
signals and for supplying an output signal^ characterized in that 
the method comprises the steps: 

determining [determines the] coefficient updates in the 
frequency domain^ and 

reducing [that the method reduces] the effect of 
correlation between the input signals on the coefficient updates. 
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REMARKS 

The specification has been amended in various places to 
correct typographical and grammatical errors. The specification has 
also been amended to add section headings. 

The claims have been amended to more clearly define the 
invention as disclosed in the written description. In particular, 
the claims have been amended for clarity. 

When the Examiner takes this case up for examination, it 
is respectfully requested that this Preliminary Amendment be taken 
into consideration . 



Respectfully submitted, 



Edward W. Goodman, Reg. 28,613 
Attorney 

Tel.: 914-333-9611 
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The invention relates to a filter as described in the preamble of Claim 1. 
The invention further relates to a signal processing device comprising such a filter. 
The invention further relates to a teleconferencing system. 
Further the invention relates to a voice controlled electronic device. 
The invention also relates to a noise cancellation system. 

The invention further relates to a method as described in the preamble of claim 14. 

Recent developments in audio and video systems require the use of multiple channel 
processing and reproduction with acoustic echo cancellers (AEC) and noise cancellers. 
For example in mini group video conferencing systems multiple channel transmission leads to 
a better "localization" of the diverse people in the room. This enhances the intelligibility and 
naturalness of the speech. 

Further multiple channel echo cancellation is needed in voice controlled stereo audio and 

video equipment such as television receivers, radio receivers, CD players etc.. 

A multiple channel AEC can in general not be created by simple combination of multiple 

single channel AEC's. 

From the United States patent US-A 5,828,756 a method and apparatus are 
known of a stereophonic communication system such as a teleconferencing system, which 
involves selectively reducing the correlation between the individual channel signals of the 
stereophonic system. Herein non-linearities are added to the input signals to reduce the 
correlation. However by adding these non-linearities audible artifacts in the output signals are 
introduced. These non-linearities can (sometimes) be accepted in teleconferencing systems but 
are certainly not acceptable in other applications such as supplying music etc. 

It is, inter alia, an object of the invention to provide a filter, which overcomes 
the objections of the prior art. To this end a first aspect of the invention provides a filter as 
claimed in claim 1 . 
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Herewith the performance of the adaptive filters is improved without a huge increase in 
computational complexity. 

A second aspect of the invention provides a signal-processing device as claimed in claim 8. 

5 A third aspect of the invention provides a teleconferencing system as claimed in claim 1 1 . 

A fourth aspect of the invention provides a voice controlled electronic device as claimed in 
claim 12. 

l o A fifth aspect of the invention provides a noise cancellation system as claimed in claim 1 3 . 
{ : A sixth aspect of the invention provides a method as claimed in claim 14. 
An embodiment of the invention comprises the features of claim 2. 

!l - 15 

| r ; The invention and additional features, which may be optionally used to 

j" implement the invention to advantage will be apparent from and elucidated with references to 

C; the examples described below, hereinafter and shown in the figures. Herein shows: 

20 Figure 1 schematically the multiple input adaptive FIR filter, according to the 

invention, 

Figure 2 schematically the calculation of the output of the FIR filter, according 
to the invention, 

Figure 3 schematically the calculation of Y in the Multiple Input Partitioned 
25 Frequency Domain adaptive filter, according to the invention for the case with direct inverse 
power estimation, 

Figure 4 schematically the calculation of the coefficient vectors w, according 

to the invention, 

Figure 5 a schematic example of a stereo echo cancellation in a 
30 teleconferencing system according to the invention, 

Figure 6 a more detailed schematic example of a teleconferencing system 

according to the invention, 

Figure 7 a schematic example of a voice controlled device according to the 

invention, and 
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Figure 8 a schematic example of a noise canceller according to the invention. 

In the description the equations, matrices, etc are shown as described below. 
Signals are denoted by lower case characters, constants by upper case. Underlining is used for 
5 vectors, lower case for time domain, and upper case for frequency domain. Matrices are 
denoted by bold face upper case, like I. The dimension is put in superscript (e.g. the B x Q 
matrix X is given by X 8 '®, for a square matrix the second dimension is omitted). Diagonal 

matrix are denoted by a double underline, like P , with its diagonal denoted as P = diag j-P} . 
A subscript z, like m, denotes the z'th version. The k'th element of w is given by (w) k . Finally, 
10 appending [k] denotes the time index, (.)* denotes the transpose, (.)* the complex conjugate 
and (.) h the Hermitain transpose (complex conjugate transpose). 

5 I- A general multiple input adaptive FIR filter, depicted in figure 1 , uses the S 

? I signals x 0 [k] until [k] to remove unwanted components correlated with these signals in 
" l 15 the signal e[k\ The signals x 0 [k] until x s _ x [k] are input to S FIR-filters W 0 until W s _ { , with 

outputs e Q [k] until e s ^ [k\ The goal of the update algorithm is to adapt the coefficients of the 
! : FIR filters in such a way that the correlation between r [k] and the input signals x 0 [k] and 

x s _ Y [k] is removed. 



20 



For S > a > 0 the FIR filter W a performs the convolution of the signal x a [k] and 
the coefficients w^k] . . . w^-iM of that filter. The output signal e a [k] of such a filter can be 
described as follows 



with for S > a > 0 
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x a [k-N + l}) 
x a [k-l] 
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(2) 



w 



(3) 



~ 5 



The output of the multiple input adaptive filter is given by 



r[*] = e[*]-5XM- 



a=0 



(4) 



These filter parts of the separate (adaptive) filters Wo until Ws-i can be 
: 10 implemented efficiently in frequency domain with help of partitioning, block processing and 

Discrete Fourier Transforms (DFTs). A reduction in computational complexity is obtained 
; since the convolutions per sample in the time domain transform to elementwise multiplications 
per block in the frequency domain. We use block processing with block length B and DFTs of 
length M, with M > N + B - 1 . The transformation of the input signals can be described for 
15 S >a>0 by 



X M a [kB]=¥ M - 



fx a [kB-M + l]\ 
x a [kB] 



(5) 



where F M is the M x M Fourier matrix. The (a,b)'th element (for 0 < a < M,0 <b<M)of the 
20 Fourier matrix is given by 



where y = V-T. 



(6) 
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The filter can then be computed in the frequency domain, by 



lN=(0 [kB] = 



o=0 



fe[kB-B + \]\ 
e[kB] 



(7) 



Note that the frequency domain filter coefficients are related to the time domain coefficients, 
5 for all S > a > 0 this can be denoted by 

(8) 

W c,nA 1 ] 
0 



W?[l] = F M ■ 



To obtain an efficient implementation, the block length B must be chosen in the 
same order as the filter length N, which results a large processing delay. 
: : To reduce the processing delay, the filter can be partitioned into smaller pieces 

A 0 of length B and with g = \N I B] we get the implementation of figure 2, that can be described 
by 



I[&?H0I*)X £X [{k-i)B^[kB} 



a=0 /=1 



(9) 



15 with W^[l] = F M 



20 



w 



w 



'a A 1 ] ^ 
J] 



w 



aJB+B-l \l1 

0 



For the update part of the filter one can use S separate update algorithms to 
improve convergence behavior the input signals can be decorrelated separately in the time 
domain by using RLS like algorithms, leading to a huge computational complexity. 
Complexity reduction can be obtained by implementation in the frequency domain with 
(partitioned) Block Frequency Domain Adaptive Filters as described in G.P.M. Egelmeers, 
Real time realization of large adaptive filters, Ph.D. thesis, Eindhoven University of 
Technology, Eindhoven (The Netherlands), Nov. 1995. When there is correlation between the 
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input signals of the filters this might still lead to very bad convergence behavior, due to the 

non-uniqueness problem. 

In this application it is proposed to use a partitioned algorithm in the frequency 
domain that reduces the effect of the crosscorrelation between the input signals on the 
algorithm's convergence behavior. To reduce complexity block processing with block length 
A to compute the sum of A consecutive updates with each iteration is used. For S > a > 0 the 
coefficient vectors w» [U] are partitioned into g» parts of length Z with g u =\N/ z\ such that 
for S> j>0 



10 



22 loM 



with for S> j>0 and g u >i>0 



K* + z-.[«I| 
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A Fourier transform length L is used with L > Z + A - 1 , we define the input signal Fourier 
transforms for S > a > 0 as 



X L a [lA]=¥ L .x L a [lA] 



x a [lA-L + l]\ 



x a [lA-l] 
xM 



20 



The diagonal matrices £ [m] contain the vector X L a [u] as main diagonal, so for S > a > 0 
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X L a [lA] = diag\x L a [lAjf. 



An overlap-save method is used to compute the correlation involved in the adaptation process 
5 in the frequency domain, the frequency domain transform of the residual signal vector equals 



R L [lA] = ¥ l 



The set of update equations for the filter coefficients in the MFDAF (Multiple Input 
10 Frequency Domain Adaptive Filter) algorithm can now be defined for g u > i > 0 by 



*f,[('+iMI 
1)4 



( i 



w 



S-l 



w 



(^ L s jA-iz]y 



15 



-.S.Z.S.L 



^[lA-iZ]} 



R L [IA] 



with 











= 2a{l> SL [lA§\ 


few)* 









20 
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and the transformation matrix G s z,s L is given by 
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G 



S.Z.S.L 



\Z,L \ 



0 



Z,L 



•. 0 



5 with 



G z - L =(J Z 0 z ' l - z ){f l Y. 



10 The input channel's power matrix P s L [lA] is defined by 



P" [IA] = \ {x SL ' L [lA])* {X SL ' L [IA])' } 



L 
L 



15 where 



X SL > L [IA]-. 



f \ 

2;.,m 



20 The expectation operator s{} of the above equation has to be replaced by an estimation 
routine. 
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The power matrix P S L [lA] can be estimated by 



P sx [lA]=(l-y)P SL [(l-i)A] + t( X SL - L [lA] )* -(X ^[lAf 



(10) 



To reduce the number of multiplications, the stepsize parameter a of equation is 
incorporated in the above power estimation routine by defining 



5 




so 



2 a (p-[/4"'=(pfN) _1 - 



(12) 



Estimation of the power matrix [lA] can then be done by 



! 10 



P°niA]=(l-r>VZ L [(l-l)A] +1 f-.( X S ^[IA) J •( X S ^[IA] )'. 



2aL 



(13) 



~; Direct application of this algorithm leads to stability problems. When the input signal power in 

S : a certain frequency bin is very small, the power in that bin will decrease to a (very) small 
\ v value. The inverse of the matrix will then have large values and will be inaccurate (due to 
f J 15 numerical and estimation errors) In the ideal case, the eigenvalues of the power matrix 
™ estimate cancel the eigenvalues of the input signal power matrix. Due to estimation errors this 
goal is only approximated, and the mismatch introduces a deviation from the ideal 
convergence behavior and might even lead to instability. Especially when some of the 
eigenvalues of the estimate of the inverse power matrix get large, and do not (exactly) cancel a 
20 (small) eigenvalue of the input signal power matrix, instability might occur. A lower limit to 
the eigenvalues of the estimate of the power matrix can solve this problem. In the single 
channel case (or when we forget the cross-terms) we can solve this problem by applying a 
lower limit to the lower values. We can do this because the eigenvalues of a diagonal matrix 
are equal to the elements of the diagonal, so we actually limit the eigenvalues. In the multiple 
25 channel case we also have to limit the eigenvalues to assure stability, but these no longer equal 
the elements on the diagonal. 



now create a lower limit on the eigenvalues by shifting them by the suggested minimum. We 
know that for all eigenvalues X of a matrix A, the determinant of A+(P min - /L f )*I must be 
30 zero. So for all X" , eigenvalue of A-f-P min 1 , there must be a X, eigenvalue of A, such that 



We know however that all eigenvalues of the power matrix are positive. We can 
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X =X+P min (and the other way around). This means that by adding a constant P min to the main 
diagonal of a matrix, all eigenvalues of that matrix are shifted by P min .)- So we define: 



which results in 



P c/ 



■ min 



2a 



r 



The effect of this shifting of the eigenvalues on the (theoretical ideal) convergence behaviour 
10 of the algorithm will be very small, and in practice the algorithm is much more stable. 

Although P a s ,L [IA] is a sparse matrix, computing its inverse would still require L inversions of 
SxS matrices, which takes in the order of L ■ S 3 operations. As we however do not need the 
15 inverse itself, but only its matrix-vector product with the input signals we can also look at it as 

solving the system 





















Y 1 [IA\ 

\ =0 L J > 







20 



which requires in the order of L ■ S 2 operations. Another option is to estimate the inverse of 
P S L [lA] directly, which also results in a number of operations proportional to L-S 2 . 
However, also in this case we have to limit the eigenvalues to assure stability. 



25 



A simple algorithm is given by: 
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with 



5 



Q SL ' L [IA]=(V SL [IA\Y 



v X L [lAj 

V =0 L J 



(14) 



10 We can incorporate a, which results in 



15 



20 



The above algorithm does not guarantee a matrix (p/ 1 [W])"' with positive eigenvalues, and 
therefore introduces a lot of stability problems. In the single channel case we are able to 
stabilize the algorithm by using a lower limit on the estimate, which automatically results in 
positive eigenvalues because the matrix is diagonal, but that is not possible in the multiple 
channel case. 

Positive eigenvalues 



An exact transformation of an algorithm for estimating P C S L [lA] with positive eigenvalues will 
lead to an estimation algorithm for the inverse with positive eigenvalues. This can be done by 
25 using the matrix inversion lemma. When there is matrix A such that 

A=B + CDE (15) 



then the inverse matrix (A)" 1 of A can be expressed by 
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(A)' 1 = (B)~ l -(B)- 1 -C-((D)- 1 +E-(B)~ 1 -Q- 1 -E-fB;- 1 • (16) 

By choosing 

A = P^[W] 

b = (l-r)-P^ [(i -i) a] 

5 c = ( x"-' [iA]y (iy) 

D =-^-1* 

E = C* =(X 5 L ' i [/^] )' 

and 

Q = (B)" 1 C 

= E-(B)-' (18) 

= ~(P S a L [(l-l)A])- 1 .(X SL ' L [lA]y 
\-y 

10 we obtain by using equation (14) 

(V! L [lAY l = J_P B ^[(/_i)^]-' -Q sl - l [IA]-(D l [IA])' 1 ■{Q SLL [lA]) h (19) 
1-y — 



with 

15 



B L [lA]=—I L +(X SL ' L [lA]y -Q SL - L [lA]- (20) 

— y 



Algorithm (19) involves no matrix inversion, and only Z-/2 + 1 divisions, as the matrix 
[lA] of equation (20) is a real valued diagonal matrix. 

20 

Limits on the eigenvalues 
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An operation on the inverse power matrix that is equivalent to adding a constant to the 
diagonal of the (non-inverse) power matrix would solve the problem. Adding a full 
(S • L) x (S • L) identity matrix and trying to find an equivalent operation on the inverse power 
matrix with the matrix inversion lemma results in an algorithm that requires the matrix 
inversion we would like to avoid, so we try 



2aL 



(21) 



with 



sio (XL L 'W -(XL W N)' =(X 5i ' L M)* -(X SLL [lA]y +P raiD -2aL-I 



S-L 



(22) 



:15 



As the matrix I has rank S-L and the product matrices (Xf^ L [lA]y -(Xj^ and 
(X s L ' L [lA])' ■ (X S L ' L [lA])' both have a rank of (at most) L this is not possible for S>1 . As we 
need the average of (X SL - l [lA]y -(X^fw])' , we can find a solution by taking the average 
over S consecutive updates. We will try to find Xf^" 1 [lA] such that 



[5-1 



= s\^(X SL ' L [(l + a)A]y-(X SL - L [(l + a)A])] + P^ -2ccLS-I SL 



[a=0 



(23) 
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with for / = / mod S 















+ 






k =o L J ) 







= X SL ' L [lA]+ 



(24) 
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f 5-1,5-1 



U 



1,5-1 



^ W 0,S-I 



For 5 = 1 we get 



l S-\,\ U S-1,0 



M 0,l M 0,0 J 
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(25) 



(26) 



10 



For 5 > 1 there are an infinite number of solutions. If we try to keep the maximum distorsion 
(the largest matrix element) as small as possible, we have to choose for all S>j>0 and 
S > i > 0 

u..=+JP ■ -2aL- (27) 

If there is a real symmetric matrix U L for S=L then a real symmetric matrix V 21 for S = 2Z is 
given by 



U 2i = 



U L ^ 



(28) 



15 Using the above equation we can construct all U 2 ' with i > 0 . If S + 1 is not a power of two, 

then we will use the matrix U 2 ' where 2* > S + 1 > 2'' 1 , and use the last S rows. In table 1 the 
power matrix estimation algorithm using a direct inverse estimation with limits on the 
eigenvalues is summarized. 
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Initialization 

1 S =2^ log2S+1 ^ 



for i = \to log 2 (S u )do 
2. begin 



U 2 



'u 2 U 2 ^ 



U' 



•U' 



end 

3 . Initialize power matrix. 



Iteration 
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10 













+ 






V 



U S u -\,ImodS u 



U S -5+1,/ mod 5„ "I 



2. Q^[ W ] = J-.( Pa - [(/-D4" 1 -(X-W 

3 . D i [L4] = — I L +(X^ i M)' 'Q Ki N 

4. Ca/cwtoe(D L [M])-' 

(pfjLMr 1 = T J -(p«;L[(/-i^])- 1 

5. i-r 

Table 1 : Direct inverse power update with limits. 



15 



Note that the inverse of P S L [IA] is also a sparse matrix with the same structure and we define 
r T [IA] ... T [lA] T^Z/P 

=S-1,S-1 1 J =S-1,1 L J =0 L J 



rp Si r 1 = 
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where for 0<i<S and 0<f<S 



10 



15 



20 



25 



30 



llllA^diag&jilA]}- 

Figure 5 shows schematically an example of a teleconferencing system TS5 
using a stereo echo canceller SEC5 with adaptive filters AF5 (only one shown). The 
teleconferencing system comprises a far room FR5 and a near room NR5. The adaptive filter 
AF5 has to filter the stereo echo signals. 

Figure 6 shows an example of a stereo echo canceller SEC6 used in a 
teleconferencing system TS6. The stereo echo canceling has to be performed between the near 
room NR6 and the far room FR6. In this example also programmable filters PF61 and PF62 
are used to improve the performance of echo canceling. Programmable filters are described in 
US-A-4,903 5 247. 

Further also the output of the programmable filters is supplied to a dynamic 
echo suppressor DES6, which is coupled with an output to the output of the stereo echo 
canceller. Dynamic echo suppressors are described in WO-97-45995. 

A full stereo communication requires four stereo AECs, two on the near end 
side and two on the far end side. In figure 6 only one of those echo cancellers is depicted. Note 
that on each side we can combine the input signal delay-lines, the FFTs and the multiplication 
by the inverse power matrix of the two echo cancellers, which implies that the relative extra 
computational complexity for removing the crosscorrelation is even further reduced. The 
performance of the AECs further improved by adding Dynamic Echo Suppressors as shown. 

Figure 7 shows another application wherein a stereo echo canceller SEC7 is 
used in a voice controlled audio (and video) system VCS7. To be able to recognize the local 
speaker by a voice recognition engine we have to cancel the sound emitted by the audio set 
through the loudspeakers. This is done by using the stereo echo canceller SEC7. To improve 
the stereo echo canceling also in this example the programmable filters PF71 and PF72 are 
used, and the Dynamic Echo Suppresser DES7 is used. The output of the Dynamic Echo 
Suppressor is coupled to a voice recognizer VR7 for handling the filtered signal. 

Figure 8 shows an example of a noise canceller NC8 for canceling the noise 
received on microphones in a room R8 together with a speech signal spl from a person in the 
room. In this example the microphones supply signals to a beam former BF8 which beam 
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former supplies signals to the noise canceller NC8 and to programmable filters PF81, PF82 
and PF83. Further the noise canceller comprises a dynamic echo suppressor DES8. The output 
of the Dynamic Echo Suppressor is coupled to the output of the noise suppressor to supply an 
estimate of the received speech sp2. 
5 Also in the multiple input noise canceller we can apply a DES (which is in fact 

not suppressing an echo, but is similar to the DES in the AEC's case) and programmable 
filters to improve performance, as shown in figure 8. An extra problem is that the inputs of the 
filters may contain some elements of the desired signal ("signal leakage"), because the 
beamformer is not perfect. When the desired signal is speech signal, a speech detector can be 
1 o used to improve the behaviour of the MFD AF. 
■ 2 Above some examples of application of a stereo echo canceller and of a noise 

u; canceller are described. It is to be noticed that the invention can be used in different 

£ applications and is not restricted to the described applications. 
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1 . Adaptive filter comprising at least two inputs for receiving at least two signals, 
and an output for supplying an output signal, characterized in that the coefficient updates are 
determined in a transformed domain and that the filter comprises means to reduce the effect of 
the correlation between the input signals on the coefficient updates. 

5 

2. Adaptive filter according to claim 1 , characterized in that the transformed 
;3 domain is the frequency domain. 

pr 3. Adaptive filter according to claim2, characterized in that the filter comprises an 

b. 10 update algorithm with transformed auto- and a cross correlation matrices. 

£: 4. Adaptive filter according to claim 2, characterized in that the reduction of the 

? : s effect of the correlation is achieved by multiplying the frequency domain input signals with 
v! s the inverse of the input channel's power matrix. 

l- : 15 

5. Adaptive filter according to claim 4, characterized in that the input channel's 
power matrix is determined by a first order recursive network, with the product of the 
frequency domain input signals and their conjugates as input, and further characterized in that 
at each iteration a certain positive value is added to all elements of the main diagonal. 

20 

6. Adaptive filter according to claim 4, characterized in that the algorithm 
comprises a solving a linear set of equations with the input channel power matrix as one of the 
elements of the equations. 

25 7. Adaptive filter according to claim 3, characterized in that the inverse of the 

input charmers matrix is estimated directly, using a recursive update algorithm, and further 
characterized in that a limit is imposed on the eigenvalues of the matrix. 



8. 



Signal processing device comprising a filter according to claim 1 . 
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9. Signal processing device according to claim 8, characterized in that the device 

further comprises a dynamic echo and noise suppressor as a post-processing device coupled to 
an output of the filter. 

5 10. Signal processing device according to claim 8, characterized in that the signal- 

processing device comprises a programmable filter. 

1 1 . Teleconferencing system comprising at least one signal -processing device 

according to claim 8. 

10 

C 12. Voice controlled electronic device comprising at least one signal-processing 

;/i device according to claim 8. 

~-- ] 13. Noise cancellation system comprising at least one signal-processing device 

fr". 15 according to claim 8. 

C : 14. Method for filtering at least two signals and for supplying an output signal 

L" characterized in that the method determines the coefficient updates in the frequency domain 
j: : and that the method reduces the effect of correlation between the input signals on the 
20 coefficient updates. 
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ABSTRACT: 



Stereo echo cancellation is necessary to overcome the objections observed by 
for example teleconferencing, voice controlled video/audio apparatuses etc.. 
To improve the existing filters the invention provides an adaptive filter and a signal processing 
device which obtain the coefficient updates in the transformed domain, reducing the required 
5 calculation complexity. Further the filter comprises means to reduce the correlation between 
the input signals on the coefficient updates. 
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